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The present invention relates to a method of estimating the optimum service rate at a 
specified quality of service for the transmission of packets of data of different 
characteristics through a switch node comprising a buffer having a defined size. The 
invention is also directed towards a system for carrying out such a method. 

Traffic in a data network is essentially composed of individual transactions or flows 
which can be broadly categorised as "inelastic" or "elastic". Inelastic traffic applications 
are those which cannot tolerate a significant delay variation in the data network. 
Examples of inelastic traffic flows are real time video and/or voice applications. Elastic 
traffic flow applications, in contrast, are those which are relatively tolerant of delay 
variations within the data network. Examples of elastic traffic flows include electronic 
mail and file transfer. The term "data network" in this specification is to be used 
generally as to comprise any computer network or telecommunications technology that 
transfers electronic data to and from user end systems in the network. 

In the following discussion the terminology is that used in Hfeh-Performance 
Communication Networks [Jean Walrand and Pravin Varaiya (Second Edition) 
Academic Press 2000]. 

The principal network elements are links and switches. A fink transfers a stream of bits 
from the one end to the -other at a fixed rate called the- fink rate. Unks are 
unidirectional. The most important links are optical fibre, copper coaxial cable and 
microwave "wireless" links. Link rate is often referred to as bandwidth. Several 
incoming and outgoing finks terminate in a switch, a device that transfers bits from its 
incoming links to its outgoing links A switch may be equipped with one or more 
buffers. A buffer is a device capable of storing bits. 

When we view a network as an interconnection of network elements, we may 
represent the network schematically as a graph composed of nodes and edges. The 
nodes represent users (source or destination) or switches. The edges represent links. 
This can be shown as large circles representing nodes and small circles representing 



users ail connected by lines. 



Typrcally, users transmit bits in bursts: active periods are interspersed with periods of 
inactivity. The peak rate of transmission cannot exceed the link rate. The mean rate 
of transmission, by definition, cannot exceed the peak rate. The ratio: 

* 

( peak rate! - (mean rate) 
(mean rate) 

is a measure of the burstiness of the source. 

Typically, the internal architecture of a switch is highly complex, involving a multiplicity 
of buffers and scheduling mechanisms. For example with a single buffer fed by a 
single source the outgoing fink rate is the service rate S. The buffer has a fixed size b. 
The service rate S is configurable. If the mean rate of transmission of bits by the 
source exceeds the service rate, then there will be unbounded loss of data arising from 
buffer overflow. After some time, the buffer will be permanently full and arriving bits 
will be dropped. 

On the other hand, if the peak rate is less than the service rate, then the buffer will be 
permanently empty: each bit will be removed from the buffer as soon as it arrives. The 
purpose of the buffer is to deal with the intermediate situation where the service rate 
lies between the mean rate and the peak rate of the source. 



In this intermediate situation, a queue may form in the buffer. If the queue fills the 
buffer, bits will be lost by buffer-overflow. If long queues form, some bits will be 
delayed for an unaccepfably long time. The problem facing network operators is how 
to determine a service rate that keeps loss and delay within acceptable bounds; these 
bounds are known as Quafity-of-Service (QoS) targets. They are expressed 
statistically. ^For example, one might require that, within a specified period, not more 
than 1 in 10 s bits are tost or that not more than 1 in 10 3 buts are delayed for more than 
30 milliseconds. 

Since link rate is often a scarce resource, it is important to know the minimum service 
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rate required to meet the target QoS in a buffer of specified size. This is caned the 
Bandwidth. Requirement (BWR) of the system consisting of a source transmitting a 
stream of bHs to a buffer. The BWR of a system depends not only on the buffer size 
and the QoS target but also on the statistical properties of the stream of bits; these 
include the mean rate and the burstiness. 



* 



Prior Art disclosed, for example in Duffield, Lewis et al. [IEEE Journal for Selected 
Areas in Communications. August 1995] shows that the relevant statistical data 
required for the determination of BWR can be encapsulated in a single function. The 
Scaled Cumulant Generating Function [sCGFJ. An invention disclosed in PCT 
Publication No. WO 98/37708 TELIA et al.. discloses a method and system for 
estimating the sCGF online in real time and storing it as a compact traffic descriptor. 

Given the buffer size b and the QoS target Q. the BWR of the system can be 
15 calculated from the traffic descriptor C. 

In the Prior Art, as described, the source operates independently of the switch. The 
internet uses two different transport layers: User Data Protocol (UDP) and 
Transmission Control Protocol (TCP). UDP is useful for inelastic traffic such as 
telephony over the internet and audio and video streaming applications. In UDP. the 
source operates independently of the switch and the method described above applies. 



TCP is designed to give guaranteed service delivery without duplication. It is used for 
_ elastic traffic involving transactions between client and server such as-the downloadtng- 
25 of web pages, for example. It involves the use of flow control in which the source 
receives feedback from a switch. A consequence of this is that the behaviour of the 
source becomes dependent on the service rate at the switch. 

US Patent Specification No. 6,266,322 B1 (AT&T Corp) which is specifically 
3 0 referenced in totality herein describes in some detail how elastic data traffic is handled. 

Indeed this US patent specification discloses a method of dimensioning link bandwidth 
for elastic data traffic for a link in a communications network. This US patent discloses 
a method for allocating a bandwidth for a link of elastic data traffic flow. However, this 
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US patent does not disclose a method of accurately determining the minimum service 
rate to maintain quality of service requirements within the network. Further it does not 
address the problem of selecting an optimum service rate. 

5 The fundamental problem in providing quality of service in a data network is to 
determine accurately the optimum which is in effect the Minimum service rate at which 
packets of data are removed from a buffer in a router, whilst maintaining quality of 
service in the data network and optimising the available bandwidth in the network. In 
practice, data network operators use trial and error methods in setting the service rate 
10 to achieve the desired response time for delivering elastic traffic. This is costly and 
time consuming as it requires network operators to continually monitor the response 
time and reconfigure the service rate. 

PCT Publication Mo. WO 01/13557 (Fujitsu Network Communications, Inc.) discloses a 
15 system for supporting multiple application traffic types over a connection network, for 
example, elastic and inelastic traffic. Further examples of patents in the area of 
handling elastic traffic in data networks are disclosed by US Patent No. 6,115,359 
(Nortel Networks Corporation) and PCT Publication No. WO 01/28167 
(Telefonaktiebolaget LM Ericsson). 
20 

The present invention is directed towards providing a method of estimating the 
optimum service rate at a specified quality of service for the transmission of data of 
different characteristics through a switch node comprising a buffer having a defined 

size... It is also necessary to do this automatically without the use of human 

25 intervention. 

Statements of Invention 

According to the invention there is provided a method of estimating the optimum 
30 service rate at a specified quality of service for the transmission of packets of data of 
different characteristics through a switch node comprising a buffer having a defined 
size, comprising the initial steps oft- 
setting the target quality of service (QoS); 
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determining the size of the buffer (b); 

providing a descriptor (C) for the traffic being transmitted to allow the 
5 calculation of the estimated bandwidth requirement (BWR) for that traffic; 

and * 

then, at time intervals, carrying out the steps of:- 

1 0 (a) sampling the traffic; 

(b) extracting the descriptor 

(c) configuring a servioe rate; 

15 

(d) calculating from the descriptor the BWR for the configured service 
rate; 

(e) using the calculated BWR to define a new configured service rate; 

20 

(f) iteratively carrying out steps (d) and (e) until the calculated BWR 
and the configured service rate coincide; and 

(g) defining this final service rate as the optimum service rate for that 
25 traffic at that buffer. 



In one method of canying out the invention the service rate specified in step (c) is the 
previous optimum service rate. 

30 

In another embodiment of the invention the traffic is continuously monitored and if the 
descriptor of the traffic changes, a new optimum service rate is calculated. 

In another embodiment , of the invention when the required target QoS over time 
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deviates significantly from the target quality of service initially set, the target QoS 
is reset. 

It will be appreciated that the various steps of the method described above may be 
5 earned out in various jurisdictions and to avoid unnecessary complication of language 
this has not been specified in the above and this would be particularly the case with 
telecommunication systems to which the present invention is directed that there may 
for example be an end user in one jurisdiction, an end user in another jurisdiction and 
indeed routers, switches and the like equipment in still further jurisdictions. Thus it is to 
10 be understood that the invention covers its carrying out in more than one jurisdiction. 

Further, the invention provides a closed loop control system comprising a 
communications network in which are interconnected:- 

1 5 user end systems for the delivery and reception of data; 

switch, nodes incorporating buffers; 

schedulers connected to each (at least some of the buffers?) buffer to 
20 provide priority scheduling; 

a programmable controller having means to carry out the method as laid 
out above 

25 In the dosed loop control system the controller may be directly connected to a 
specific end user output router. 

The invention also provides a computer program comprising program instructions for 
causing the computer to perform the method as laid out above or indeed to provide the 
30 means used in the control system as laid out above. Such a computer program may 
be embodied on a record medium, a computer memory or in a read only memory or 
earned on an electrical carrier signal. 
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Detailed Description of the Invention 

The invention will be more clearly understood by the following description of an 
embodiment thereof given by way of example only with reference to the accompanying 
5 drawings in which: 

t 

Figs. 1 to 4 are various graphs illustrating bandwidth requirement as a function 
of service rate. 

1 0 Before discussing in detail the invention and how it is carried out it is advantageous to 
state a few simple facts regarding quality of service and effective bandwidth and 
bandwidth requirements. The bandwidth requirement for any particular level of service 
((B(S» is dependent on three factors. The first factor is the quality of service (QoS) 
that you require which may for example in the transmission of elastic data be 

15 described as the number of packets dropped i.e. those that have to be resent In other 
words they are not accepted at a particular buffer and must be resent by the source. 
Typically as explained above, 1 in 10 s packets dropped or alternatively that 1 in 10 3 
packets are not delayed by more ffian 30 milliseconds are often considered 
acceptable. 

20 

The second factor is the size of the buffer which is preconfigured. The third factor that 
effects the bandwidth requirements is effectfvefy the nature of the actual data being 
transmitted. This as already explained, can be described statistically and there are 
various methods of providing a descriptor of that data which descriptor relates to 
25 certain statistical properties of the data being transmitted. Accordingly therefore one 
can state 

B(C): « BWR (C, b, Q) 

3 0 Where C - the characteristic of the traffic 
b - buffer size 
Q - Quality of Service 

As already discussed and explained above, for an elastic traffic source, one can no 
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longer assume that the traffic descriptor of the source is independent of the service 
rate at the buffer. Consequently the BWR as we have described it become a function 
of the service rate S. We denote the BWR for fixed buffer size and fixed QoS target 
by B(S) as illustrated in Fig. 1. 

5 

The present invention is based on a simple empirical discovery that for small values of 
service rate i.e. for small values of S the bandwidth requirement for that service rate 
will be greater than the service rate and that for large service rates the bandwidth 
requirement will be less than the service rate. Furthermore, the bandwidth requirement 
10 increases as S increases. 

Thus we have observed that, for elastic traffic sources, B(S) increases continuously as 
S increases. Furthermore, we have observed that, for small values of s, B(S) is 
greater than S, for large values of S, B(S) is less than S see Rg. 2. 

15 

Referring now to Rg. 2 what we do know about traffic is that the bandwidth 
requirement for a particular level of service is somewhat as shown. We know that the 
bandwidth requirement will look somewhat like the graph drawn but in every case we 
do not know exactly what it is. However at the specific point S* in Fig. 2 the bandwidth 

2 0 requirement is equal to the service rate from that particular size. 

It foflows that, for an elastic source, the Optimum Service Rate is the unique value S* 
for which S=B(S). Hence any method of solving iteratively the equation S=B(S) yields 
a method for determining S*. In this specification one method for solving the equation- 
25 iteratively and hence determining S* is described. The method does not rely on first 
determining the function B(S). 

Assume the buffer size b to be known. 
Rx the QoS target Q. 

3 0 Configure the service rate at some initial value St 

Estimate the traffic descriptor for the source and use it together with the values b and 
Q to determine the BWR value Bi: = B(Si) see Fig. 3. 



- 9 - 



Next configure the service rate to be S2 given by S^Bi see Fig. 4, 

Repeating the procedure, we use the scheme: 

5 Forn=1,2 

Put Srn-1 = Bn t 

to get a sequence Si, S 2l 

io As n increases, Sn converges to S*. 

It will be appreciated that if Si < B(Si), the sequence increases to S*; if Si>B(Si), the 
sequence decreases to S*. 

15 In practice, the process is continued indefinitely. In the event of the source changing 
other than m response to the service rate (for example, changing the software 
package that is running) a new function B(S) becomes operative. 

The method here discloses has the property that the service rate sequence will 
2 0 conveige to S*, the solution of the equation S = B(S). 

Essentially by calculating the estimated bandwidth requirement for the particular 
service rate it is possible to iteratively find the optimum service rate, namely the 
minimum service rate to handle that particular traffic. - 

25 

You start the operation with a service rate Si and then determine by online 
measurement the traffic descriptor of the source. This is done for a specified size of 
buffer and quality of service required. Then you calculate the bandwidth requirement 
B1. You reconfigure the service rate to be S2 given by S 2 = B1. Repeating this process 

30 iteratively you obtain a sequence Si, S 2 , of service rates that converges to the 

optimal service rate S*. In practice, the service rates Si, S 2 are reconfigured at 

regular time intervals such as for example 5 minutes. 

It also has to be appreciated that in many instances it will be necessary to cany out the 
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operation indefinitely. A reason for this would be for example where the software 
packages or operations being run are changed. In which case, the bandwidth 
requirement function changes and the method ensures that the service rate converges 
to the optimal value corresponding to the new bandwidth function. 

5 

It will be appreciated that the invention can be carried out in many jurisdictions and that 
therefore it would not be unreasonable to find that certain operations are earned out in 
one country and more carried out another. 

10 It is envisaged that there are many ways that the invention may be earned out by 
computers and similar equipment suitably programmed. Further the information and 
data generally supplied will allow many and varied control operations to be earned out 
using the invention. 

1 5 Essentially what the present invention does is provide packet level quality of service on 
a data network where the rate at which a source emits data packets adapts to utilise all 
the available bandwidth. The present invention determines accurately the minimum 
service rate which is obviously the optimum service rate required to achieve a target 
level of service. For example in the remote querying of a database, the application 

2 0 level response time increases with an increase in packet delay caused by the queuing 
of packets in the buffer at a network element. As has been explained above, in order 
to achieve acceptable response times ways must be found to achieve a quality of 
service target expressed as delay restraints. Present systems do not allow this. 

25 The present invention provides a way of directly controlling packet level quality of 
service. Essentially the present, invention is "lightweight" and^ capable of being 
incorporated in dosed loop control systems as described with reference to Fig. 4 will 
allow the automation of the operation and avoids manpower intensive operations now 
required in changing the provisioning in a system with changing traffic patterns. 

30 . 
In this specification the terms "comprise, comprises, comprised and comprising" and 
any variation thereof and the terms "include, includes, included and including" and any 
variation thereof are deemed to be totally interchangeable and should be afforded the 
widest interpretation possible. 
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This invention is in no way limited to the embodiment shown and may be varied in both 
construction and detail within the scope of the claims. 
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CLAIMS 

1i A method of estimating the optimum service rate at a specified quality of 
service for the transmission of packets of data of different characteristics 
through a switch node comprising a buffer having a defined size, comprising 
the initial steps oft- 
setting the target quality of service (QoS); 
determining the size of the buffer (b); 



providing a descriptor (C) for the traffic being transmitted to allow the 
calculation of the estimated bandwidth requirement (BWR) for that traffic; 
15 and 



then, at time intervals, carrying out the steps of> 

(a) sampling the traffic; 

(b) extracting the descriptor; 

(c) configuring a. service rate; 



2 5 (d) calculating from the descriptor the BWR for the configured service 

rate; 

(e) using the calculated BWR to define a new configured service rate; 

30 (f) iterativefy carrying out steps (d) and (e) until the calculated BWR 

and the configured service rate coincide; and 

(g) defining this final sen/ice rate as the optimum service rate for that 
traffic at that buffer. 



A method as claimed in ciaim 1 , in which the service rate specified in step (c) is 
the previous optimum service rate. 

A method as claimed in claim 1 or 2, in which the traffic is continuously 
monitored and if the descriptor of the traffic changes, a new optimum service 
rate is calculated. 

A method as claimed in any preceding claim, in which when the required target 
QoS over time deviates significantly from the target quality of service initially 
set the target QoS is reset. 

A method as claimed in any preceding claim, in which the steps of the method 
are carried out in more than one jurisdiction. 

A closed loop control system comprising a communications network in which 
are interconnected:- 

userend systems for the delivery and reception of data; 

switch, nodes incorporating buffers; 

schedulers connected to each (at least some of the buffers?) buffer to 
provide priority scheduling; 

a programmable controller having means to cany out the method of any 
preceding claim. 

A closed loop control system as claimed in claim 6, in which the controller is 
directly connected to a specific end user output router. 

A computer program comprising program instructions for causing a computer to 
perform the method of claims 1 to 5 inclusive. 
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9. A computer program comprising program instructions for causing a computer to 
provide the means of claims 6 or 7 inclusive. 

10. A computer program as claimed in claim 8 or 9 embodied on a record medium. 

5 

11. A computer program as claimed in claim 8 or* 9, embodied in a computer 
memory. 

12. A computer program as claimed in claim 8 or 9, embodied in a readonly 
10 memory. 

13. A computer program as claimed in claim 8 or 9, earned on an electrical earner 
signal. 
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